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Abstract 

We extend the construction by Kiilske and lacobelli of metastates in finite-state 
mean-field models in independent disorder to situations where the local disorder terms 
are a sample of an external ergodic Markov chain in equilibrium. We show that for 
non-degenerate Markov chains, the structure of the theorems is analogous to the case 
of i.i.d. variables when the limiting weights in the metastate are expressed with the 
aid of a CLT for the occupation time measure of the chain. 

As a new phenomenon we also show in a Potts example that for a degenerate non- 
reversible chain this CLT approximation is not enough, and that the metastate can 
have less symmetry than the symmetry of the interaction and a Gaussian approxima- 
tion of disorder fiuctuations would suggest. 

AMS 2000 subject classification: 82B44, 82B26, 60K35. 
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1 Introduction 

Metastates are useful concepts in analyzing the large-volume dependence of disordered 
systems, both of lattice and mean- field systems. They go back to the constructions of 
Aizenman and Wehr [1], and Newman and Stein |18| . 

In the present paper we continue to analyze a class of mean- field systems, moving 
from a situation where the quenched disorder was assumed to be i.i.d. [11| to a situation 
where the disorder is generated by a Markov chain. Our models have a finite local state 
space E, and a finite space E' of possible values of the local disorder variables. While in 
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the previous analysis the disorder variables were assumed to be i.i.d. over the sites, we 
now treat a quenched disorder which is correlated and generated by a Markov chain with 
transition matrix M. For a study of the Curie- Weiss model in a dynamical external field 
see [8ll20|. 

A metastate is a probability measure on the infinite-volume Gibbs measures of a dis- 
ordered system which intuitively gives the likehood to pick a Gibbs state in a large but 
finite volume. For precise definitions see below and refer to the books [H ^7\. Non-trivial 
metastates can occur when the phenomenon of random symmetry breaking appears, mean- 
ing that two or more states are equivalent on the average, but their symmetry is broken 
by disorder fluctuations in finite volume. For examples of disordered models with such 
random symmetry breaking see j^l El IHl ESI [HI US]) for genuine applications of metastate 
idea to spin-glasses see 119] and in particular the groundstate uniqueness result in 2D 
proved in 0. 

Now, in the finite-type mean-field models of precise limit theorems for the weights 
in the metastates were derived, combining a multivariate CLT for disorder fluctuations 
and a large-deviation analysis of the spin-part of the model. Further a geometric picture 
was given to identify the invisible states, namely those Gibbs states which are always 
overshadowed by disorder fluctuations favoring other competing states. 

In the present paper we ask: What changes if the external randomness comes from a 
Markov Chain? 

Suppose we are dealing with a non-degenerate Markov chain on a finite state-space at 
first, meaning that the covariance matrix Sjvf of the limiting Gaussian distribution of the 
occupation time-vector of the Markov chain M has the full possible rank. Then the basic 
structure of the theorems stays the same, using the same geometric construction to identify 
visible Gibbs states j and their weights wj. However, let us stress the main difference to the 
independent case, which is that the wj^s are given in terms of T,m and this object carries 
more information about the Markov chain then just its invariant distribution it. Which 
states are Gibbs states depends on vr, but the precise form of the weights and whether a 
given state is visible or not can vary over Markov chains having the same tt but different 
transition matrix M. This is different from the i.i.d. case where the single-site distribution 
TT completely specifies the disorder distribution. 

New phenomena on an even more fundamental level appear when we allow for Markov 
chains which are degenerate, i.e., whose Ejvf does not have full rank. We specify to a 
concrete example and look at the 3-state random field Potts model, with 3-state local 
random fields coupling by delta-interaction in the Hamiltonian to the spins. We take M 
on E' = {1,2,3} to be doubly stochastic ergodic matrix which can be seen as a softened 
version of a permutation matrix, where one keeps however one (and only one) transition 
between an ordered pair of states to be deterministic, say from state 1 to 2. Although 
the equidistribution on the states is invariant and the covariance matrix Em becomes 
degenerate but is symmetric under exchange of states 1, and 2, the metastate for the 
random model with disorder generated by the Markov chain in equilibrium is not symmetric 
under an exchange of the spin labels 1 and 2. Such a phenomenon is only possible because 
of two features: The almost degeneracy between two Gibbs-states up to finite but non-zero 
free energy differences in arbitrary large volumes in the possible realizations of the chain. 
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and the lack of time-reversal symmetry of the Markov chain. 

The remainder of the paper is organized as follows. In Section 2 we review definitions 
about metastates and the constructions from [11] needed for mean-field models, including 
the geometry of free energy fluctuations and derivation of weights for pure states. Then 
we are ready to give the result of the present paper about metastates for non-degenerate 
Markov chains. Next we present the results for the 3-state Potts model with quenched 
disorder generated by a degenerate chain. In Section 3 the proofs for non-degenerate 
Markov chains are given, building on results of the previous paper [11]. In Section 4 the 
proof for the 3-state Potts model in the degenerate case is given. 
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2 Main Results 



2.1 Mean- fie Id Spin Models in a random field generated by a Markov 
chain 

2.1.1 The Boltzmann distribution of the spins 

For spin variables cr{i), at each site i G {!,..., n} taking values in a finite set E, we 
consider a mean- field model with Hamiltonian nF{v), and Boltzmann distribution given 
by: 

MF,n[^(l),---,?7H](cr(l) = . . . ,o-(n) = u(n)) 

1 " (2 1) 

= z„h(i),....,(n)i (-"^(^"» n "["WK"-' 

where = ^ X]?=i is the empirical spin distribution. The Boltzmann distribution 
depends on the quenched disorder ?7(1), . . . via the a-priori distribution a\b] G V{E), 

b ^ E' , where the type-space E' of the local disorder variables is taken to be finite. 
Throughout the paper we use the notation V{E) for the probability measures on a space 
E, not mentioning the sigma-algebra explicitly unless necessary. 



2.1.2 The Markov chain of the disorder variables 

Let the probability distribution of the disorder be given by a Markov chain on the finite 
space E' with transition matrix M and invariant measure vr, written in vector notation as 
7r*M = TT* where t denotes transposition of the column vector tt. The chain is supposed to 
be in equilibrium, i.e. the initial state r](0) is chosen according to the invariant distribution 
of the chain tt G V{E'), and ¥■„■ is the corresponding measure on {E')^, that is the one 
with F^{r]{i + 1) = b'\r]{i) = b) = M{b, b') and W^{r]{i) = b)= 7r(6) for alH G N and 6 G E' . 
We will assume that the transition matrix M is ergodic, meaning that there exists a power 
M'' for which all matrix elements are strictly bigger than zero. 

Given the first n realizations of the Markov chain r] we denote by 

A„(6) = {ie {l,...,n} : r/(i) = 6} 

the set of b-like sites ^ b E E'. Then the number |A„(6)| is the occupation-time of the chain 
at state b up to "time" n, and the normalized expression 

nn{b) = 

is the relative frequency of 6-like sites in the sample. The empirical spin distribution on 
the 6-like sites is given by 
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and moreover the total empirical spin distribution can be written as the scalar product of 
TTn and Ln, i.e. 

b&E' 

The equilibrium states of the system are given by the minimizers of the free energy 
functional 

i> (^[7r](z)) (2.2) 

where 



if : V{E') X V{E)^' 



\beE' / beE' 



(2.3) 



Here, 5(^11^2) = Y^aeEPii"-) log is the relative entropy. 

Together with the free energy we consider its linearization at some fixed minimizer Uj as a 
function of vr, which reads as follows 

Vi^m) - v[^Ki>,) = -Bjiir - vr] + o{\\^ - 7r||) (2.4) 

As in [llj, throughout the present paper we restrict ourselves to the following non-degeneracy 
conditions: 

1. the set M* of minimizers of the free energy is finite and the Hessian is positive at 
each minimizer. 

2. No different minimizers z>j and have the same Bi = Bj. 

Our first results concern the metastate on the level of the empirical spin-distribution. 
Denote by p[r]]{n) := /iir^,i[r/](L„) G T'{V{E)) the distribution of Ln under the finite- 
volume Gibbs-measure. The concentration of these measures around the finitely many 
minimizers of the free energy function irM* = {nvj^j = 1, . . . , A:} holds by assumption. 
How this concentration takes place in asymptotically large volumes is made precise by the 
following definition of a metastate. 

Definition 2.1 Assume that for every bounded continuous tp : V {V{E)) x [E')°° — )• M the 
limit 

lim ¥(dri)'4}{p[r]\(n),ri) = K{dp,dr])'4){p,r]) (2.5) 
n^co J J 

exists. Then the conditional distribution K[r]\{dp) = K(dp\rj) is called the metastate on the 
level of the empirical distribution. 

Before stating the theorem we must introduce the definition of the region of stability for 
the minimizers: 
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Definition 2.2 Let us define the set 

Rj := {x G TV{E'), {x, Bj) > max(x, Bu)} (2.6) 

where TV{E') = {x = (x(l), . . . : Yl\=i ^(^) ~ 0} tangent space of field type 

measures. We say that Rj is the stability region of Vj. 

We will use the following CLT for the occupation time measure (see Appendix). 

Fact: For an ergodic finite-state Markov chain, the standardized occupation-time fluc- 
tuation measure \/n(7r„ — vr) converges in distribution, as n tends to infinity, to a centered 
Gaussian distribution G with a covariance matrix on the \E'\ — 1 dimensional vector 
space TV{E'). 

Warning: Ergodicity of the Markov chain does not imply that Ej\,/ has the full rank 
\E'\ — 1, we will discuss in detail an example where this is not the case. In generalization 
of the case of i.i.d. ?7(i)'s we have the following result. 

Theorem 1 Gonsider a mean-field model with quenched disorder generated by an ergodic 
finite state Markov chain M in equilibrium vr, with full rank occupation-time covariance 
TiM- Suppose the non- degeneracy conditions 1. and 2. on the spin model (see pag^. Then 
the metastate on the empirical spin-measure exists and takes the form 

k 

K[v]{dp) = ^WjSs^i,. (dp) for F^-a.e. rj. (2.7) 
i=i 

The weights are Wj = Ps^^(G G Rj) where G is a centered Gaussian on TV{E') with 
covariance T,m- 

As in the case for i.i.d. r/(i)'s we also have the analogous version for the metastate on 
the level of spin distributions. We call a function on an infinite product of a finite space 
continuous (w.r.t. local topology) if it is a uniform limit of local functions. For probability 
measures on V{E^) we use the weak topology (according to which a sequence of measures 
converges iff it converges on continuous test-functions), and for V{E°°) x {E')°° , we use 
the product topology. 

Definition 2.3 Assume that, for every bounded continuous E : V{E°°) x {E')°° — )• M the 
limit 

lim / ndrimPuVlU) = I Jidp,dv)E{p,r]) (2.8) 
ntoo J J 

exists. Then the conditional distribution K[r]]{dii) := J{diJ,\r]) is called the AW-metastate 
on the level of the states. 
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Theorem 2 In the situation of Theorem [7} the metastate on the level of the states equal 



s 



k 

K[r]]{diJ.) = ^Wj6f,^lr,]{dn) (2.9) 
j=i 

with the product measures fJ-j[r]] := HSi 7[^(^)]( ' K'^i) given by the kernels 

r,n. , N e-'^^''('^)a[61(a) 
7 6 (alz.) = (i) (2-10) 

where dFu[a) is the a-th coordinate of the differential of the function F on V{E) taken at 
the point v £ V{E). 

The proofs of these theorems are analogous to the i.i.d. case, however with some 
additional features when decoupling properties of random field realizations in separate 
finite volumes need to be treated. 



2.2 Potts model in a random-field generated by a degenerate Markov 
chain 

The random-field Potts model of the form we consider is given by the energy 

F(^) = -^(Ki)' + ... + Kg)') 

where E = E' = {1, . . . , q} and the random fields couple locally to the spins via the local 
measures a [6] (a) = ■fB^~[- We will consider a Markov chain M with invariant measure it 
given by the equidistribution. 

The structure of the phases depends on M only through vr and the case of i.i.d. equidis- 
tributed variables has already been treated in [11] , so let us recall the relevant information 
from there: The total empirical distribution of the minimizers of the free energy functional 
has the form vj^u G 'P(-E')) with possible order in direction j, such that I'j^uij) = ^ 
^j,u{i) = for i j, where the symmetry-breaking parameter u obeys the mean- field 
equation 

= eP^ + e^ + {q-2)~ e^^+B + (<? - 1) ^^'^^^ 

In a region of small B and large /? there is a non-zero solution of this mean-field 
equation; to decide whether this or the zero solution corresponds to the global minimizer 
one looks at the corresponding free energy which reads 

e^ + q-l , /?(g-l) 2 , /3 1, eP^+^ + g - 1 

log —5 B w H u log —5 5 (2.12j 

^el^^ + eB + q-2 2q q q ^ e'^'' + + q - 2 
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There is a curve in the (/3, i?)— plane when there is an equal-depth minimum at u = and 
a positive value oi u = u*{f3,q). This means that on this curve there is a coexistence of 
q ordered states and one disordered state where u = in the random model in the very 
same way as it is happening for the nonrandom model where B = 0. 
The stability vector for the state vi^u is 



B 



-log ^ 



1 



9-2 



I 1 e^"+a+g-l ; 



pointing into the direction 1 in TV{E') which is intuitively clear since a majority of 1-type 
random fields favor the state having a majority of 1-type spins. The other stability vectors 
are given by permutation. 

Let us specialize to g = 3. In the case of i.i.d. random fields the metastate on the 
spin-distributions becomes 



1 ^ 



with = 7[^(0]( ■ Wj,u=u*{i3,q))- III particular the state for n = is invisible. This 
follows since the stability vector for this state must vanish, by symmetry, as was explained 
in the previous paper. 

We note that the form of the minimizers and the stability vectors depend only on vr. 
So, equally for a Markov chain M which has the equidistribution as its invariant measure, 
and has a non-degenerate covariance matrix S m the state for u = will stay invisible, and 
the metastate will become 



H [v] 



(2.13) 



with weights wi,W2,W3 which are given by the probabilities of finding a (in general non- 



isotropic) Gaussian in the corresponding equal-sized stability regions, see (4.2). Hence in 
general the 11)1,102, ws will be different. 



The form (2.13) changes completely, in that the metastate is now supported on mixed 



states, when we consider, for p G (0, 1) the following degenerate (but ergodic) Markov 
chain which also has the equidistribution as its invariant measure. 



M 




(2.14) 



The result for the metastate takes the following surprising form. 
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Figure 1: The transition graph for matrix (2.141 with a deterministic transition from state 1 to state 2. 



Theorem 3 The metastate in the 3-state random-field Potts model defined above, with a 



random-field generated by the Markov chain M of eq. (2.14), has the form 

1 



K[r]] 



1^ 1. 

:0,,:i[ri] + -Oi, 



1 



(2.15) 

Here the function p{/3, B) is computable in terms of the mean-field parameter u and is 
strictly bigger than 1/2 in the phase transition regime. 

Note that the metastate is supported not only on pure states but also on mixtures, and 
moreover the weights are non-symmetric under exchange of the state 1 and 2. 

Note that if we tried to apply Theorem [2] to the case of the degenerate chain we would 
find a Gaussian for the disorder fluctuations in the two-dimensional space TV{E') which 
is supported by the one-dimensional sub-space which contains the boundary between the 
stability regions for the states ^^[rj\ and ^^[r/], see Figure |2] Hence the pure state lJ?{rj\ 
should occur with a weight of 1 /2 in the metastate. In order to make statements about the 
occurrence of mixtures of /U^[?7] and l-L^[rj\ and their weights the refined analysis of Section 
4 is needed. 



Ri 



R2 




Figure 2: The Gaussian hmiting distribution of ^/nijVn — n) concentrates on the dashed hue that for upper 
half coincides with the boundary between the stabihty regions _Ri and i?2. 
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3 Metastates for non- degenerate Markov Chains: Proof 



The proof of Theorem[T]in the case of i.i.d. distributed disorder variables rehes in an essen- 
tial way on the product nature of the disorder measure. The main step in the present case 
is a modification of Lemma 2.10 in pTlJ to the dependent case. For the rest, our argument 
follows closely the proof of Kiilske and lacobelli, and we give details only where the depen- 
dence of the disorder variables come into play. Nevertheless, for the sake of completeness 
we recall some notation and results from |llj . 



Once we have the CLT for the empirical measure, the weights wj come from the study 
of the limiting probability of the n, /-dependent good sets HJ^ i of the realization of the 
randomness. For ni < n2, let us put 

^[n^M Vl] = , , f y] K - Vri2 - ni iTT (3.1) 

^ i=n\ 

and define n, /-dependent good- sets HJ^ ; of the realization of the randomness as follows 

1=1 

where RJ^ := {x E TV{E') : {x,Bi) — maxfc^j(x, i?^) > n~2+'^J|3;|| < ni}, where 
< r < 2 • The set ; of the disorder random variables allows to deduce that the 
measure on the empirical distribution will be concentrated inside a ball around the min- 
imizer ttu* . A similar concentration takes place for averages of continuous test-functions 
with respect to the empirical spin-distribution (see [11] for a proof). 

Lemma 3.1 For any real-valued continuous function g on V{E) the following concentra- 
tion property holds: 

\p[ri\{n){g) - 5(vrz>;)| < f (n), Vr? G -HJ,„,o, (3-3) 
where lim„__i.oo f{ri) = 0. 

The fundamental property of the good sets is that their probability does not depend on 
any finite number / of sites in the limit n — )■ oo. In order to make this precise, the authors 
in [H] considered sligthly different sets. For any / < n, we define a subregion ^[„o(0 of 
T^lnfl^ as follows 



i{X[i,i][v],Bi) + bn{X[i^i^n][r]],Bi) -ma.x{an{X[i i][7]],Bk)) - rnax (6„(X[i+i^„] [r/], 5^)) > J„, 



and ||X[i^„,][?7]|| < 



(3.4) 
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where 



and b„ 



The properties and the relations between TiJ^Q and 'HI„ q{1) are summarized in the fol- 
lowing lemmas. We refer to [11] for the details. 

Our first lemma states that for any fixed integer I, there is a sub region of the good-set 
which will not play any role in the limit n f oo. 

Lemma 3.2 For any integer I, ¥{'HJ^ q \ TiJ^ o(0) 9^^^^ limit n t oo. 

We also need the sets 

Bi^ii) = {E'Y X nl;:^, 

where 



(3.5) 



K 



1,^ 

i,n,l 



r/G(ii;'r-':V'^(^[m,n][ 



> 6„i((5„ + a„C2(0), and [??] || < 6„^(n4 - Cs^) 

> b:^^ {5n - anC2{l)) , and , 



with the definitions 
and 

max 



(3.6) 
(3.7) 



C2{1) = max||X[i^] 

The following holds: 

1. From the definitions follow 



(3.8) 



(3.9) 



2. For any integer /, ^{'H^'^i \ T^lni) go^s to zero in the limit n f oo [IT]. 

The next lemma represents a fundamental ingredient for what is coming next. It follows 
from a straightforward modification of Lemma 2.9 in [llj . when the multidimensional CLT 
for i.i.d. random variables is substituted with the one for Markov chains (See Appendix). 

Lemma 3.3 For any integer I, lim^i-oo ^inl'^i) = IPsm(^ ^ ^i) where G M{0,T,m)- 
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At this point we are ready to give the main step for the proof of Theorem [T] as Lemma 3.4 
Here the markovian nature of the disorder comes into play. 

First let us now summarize what we have done above for the decompositions of the various 
regions of the r/-configuration space. 

i^.^nW = (3-10) 

Then, let be V ^ continuous real-valued function on V{V{E)) x (E')"^, for some m > 0, 
the key lemma reads. 

Lemma 3.4 Under the assumption that the Markov chain disorder has a full rank covari- 
ance matrix Ej^f and, under non-degeneracy conditions 1. and 2. on the minimizers of the 
free- energy functional (see pag^, it holds 



lim 

n— >oo 



¥^{dr])i;{p[r]]{n),r]) = Wi [ F^{dr]{l), . . . , drj{m))^l^i5^p^,r]) (3.11) 

Proof: We have the decomposition: 

F^{dr])ij{p[v]{n),v)= f P.(dr/)[V'(p[??](n), r/)-V(<5.i>,, r?)]+ / P^(dr?)^(5,^^, r?) 

(3-12) 

We can assume 'ilj{p,rj) = ■ • • > ^[i,m]) f^^' ^ finite / with continuous ip &nd 

bounded gi^s. Then, because of Lemma [3.1[ the first term on the right-hand side goes to 
in the limit n — )• oo. 

Set I > m . The second term can be rewritten as (in the next we skip the dependence of 
-0 on r/(l), . . . , r]{n) in the notation) 

P,(dr?)V(5^sJ= / P,(d7y)V^((5,pJ+ / ^ P,((i7?)V^(5,pJ, (3.13) 

l,n,0 •''^I.n.oC) ''^i,n,o\^i,n,oW 

where the last term also goes to zero in the limit since tp is bounded and P,r ^^In o \ ^In o(0) 



equals zero as n goes to infinity. Moreover, from (3.10) we have the inequalities: 



¥^{dvm6^i>J< / F^{dvmSnuJ< / P.((ir/)V(<5.pJ. (3.14) 

Let us consider the last one. Conditioning on ?y(l), . . . , r]{m)^ and using the Markov prop- 
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erty, we have: 



{dr]{l), . . . ,dr]{m))'tlj{6T,oJ / F{dri{n), . . . ,dr]{m + l)\dr]{m)) 



{¥^{dT]{l),...,dr]{m))i^{6^oJ 
X / ¥{dr]{n),...,dr]{l + l)\dr]{l))¥{dr){l),...,dr]{m + l)\dr][m))] 

{P,(dr?(l),...,d7?(m))^((5,pJ 

(_E')™- 



X / ¥{dr]{n),...,dr]{l + l)\dr]{l)) / P((ir/(/), . . . , dr/(m + l)|dr/(m))} 



[ {F^{dr]{l),...,d7]{m))iP{S^o:, 

J{E')^ 



X / ¥{dr]{n),...,dy]{l + l)\dr]{l))¥{d-q{l)\dr]{m))]. 

From the Perron- Frobenius theorem (and its consequences), as presented for example in 
[7j, it follows F{dr){l)\dr]{m)) = Tr{r]{l)) + 0{{l — 'm)"^^~^ where // is the second largest 
eigenvalue of M in modulus and m2 is the algebraic multiplicity of fi. Thus the last integral 
becomes: 



/ {P^(dr?(l),...,d7?(m))^(5,i>J 

J(_E')™' 



X / P(dr/(n),...,d7?(/ + l)|dr/(/))7r(r/(/))} +0((/-m)"^2-V'~™) 



P^(dr?(l), . . . , dr?(m))V'(<5^£>J / P.(dr/(n), . . . , dv{l + 1)) + 0{{l - mr^-^fi'-^). 



A similar computation holds for the left-hand side of (3.14). Recall that < 1. Taking 



for both the limit n — t- oo first and then / — t- oo we obtain the result. □ 

We are now ready to complete the proof of the theorem. For any bounded function ip we 
write, 



1=1 



P,(d7?)V(p[??](n),r/) =Y, I K{d7impMn),v)lni„^,{v) (3-15) 

F^{dvmpMn),v)liHl^^^riv) (3.16) 
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Here the sum runs over the minimizers of the free energy. The second non-degeneracy 
assumption ensures that the second term of formula (3.15) goes to in the hmit as n — )• oo 
[11) . Then applying Lemma 3.4 we have 



lim / P^(dr?)V'(p[r/](n),??) =^ / F^idr^)^ip[r]]in),r])w,6s^^Xdp) (3.17) 



i=l 

which by the definition of AW-metastate gives us 

k 

K{dp, drj) = Kidr])wi55^,^ (dp) (3.18) 

i=l 

and 

k 

K[r^]{dp) = Y,^i5s^.S^p). (3.19) 

i=l 

This concludes the proof of Theorem [T] □ 

After we have been quite precise in the previous treatment, let us for the proof of 
Theorem [2] go a little faster. Since any continuous function on V{E°°) x {E')°° has a 
finite-dimensional approximation, it suffices to consider a local function F which depends 
on m coordinates of spins and random fields. For such an F we need to prove that 

hm / F^{drj)Fip^[ri],v) = Wj P^(dr?)F([] 7[ry(i)]( • IvrPj), r/ 

This is done using the asymptotic decoupling of the occupation times from any start- 
ing configuration, allowing for a little extra margin in volume to account for exponential 
memory loss along the path of the Markov chain. The weights Wj come out from the 



analysis performed in Lemma 3.4 exploiting the (exponentially) fast convergence to equi- 
librium of the ergodic Markov chain providing the disorder field. Together with this we 
use the concentration (for n large and r/ G "HJ^) of pp^n[n\{-^) around pj[q\{A) where 
t^jWl '■— ni^i 7[^(0]( ■ \^^3) ^^'i ^ is event depending on the first m coordinates [11]. 
With this in hand, the proof is parallel to the independent case. □ 
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4 Random field Potts model, degenerate Markov chain 



The entries of the covariance matrix T,M,n of the standardized occupation time vector in 
finite volume n are 



^M,n{hj) = n E7r((7r„(i) - 7r(i))(7r„(j) - 7r(j)) 



-kU) ■ Is 



n-l 



r=l 



+ — 'y,{n-r) [M^{j, 



,2 - vr U 



r=l 



Consider the case g = 3 of a general doubly stochastic matrix in the form 

1-a-b \ 

1 — c — d , a, 6, c, (i G (0, 1). 

-1 + a + 6 + c + d/ 



M 




(4.1) 



The limit when n tends to infinity of the covariance becomes 



-'M 



+ 



2(l+b(2-6c)+2c-2d+a(-5+6d)) 
27 {-1+a+bc+d- ad) 



1 _ b(5-6c)+5c-2(l+d)+a(-2+6d) 
'9 27{~l+a+b+c+d-ad) 



_1 _ fe(5-6c)+5c-2(l+d)+a(-2+6d) 
9 27(-l+a+bc+d-ad) 

2 I 2(l+fc(2-6c)+2c-5d+a(-2+6d)) 
9 + 27{-l+a+b+c+d-ad) 



4-8a-b-c-6bc-2d+6ad \ 
27(-l+a+bc+d-ad) 

'i-2a-b-c-6bc-8d+6ad 
27{-l+a+bc+d-ad) 



\ 



-fe— c— 66c— 2d+6ad 



9 27{-l+a+bc+d-ad) 

which still depends on a, b, c and d. 



4-2a-b~c-6bc~Sd+6ad 
27 {-l+a+bc+d~ ad) 



2 _ 2(-4+b+c+6fcc+a(5-6d)+5d) 
9 27{-l+a+bc+d-ad) 

(4.2) 



Indeed this can be done invoking the geometric series and diagonalization which is a g — 
1 = 2 dimensional problem since we always have the eigenvalue 1, using some help of 
Mathematica. 

The restriction of to the two dimensional space TV{E') gives us the weights Wj 



in the Potts-metastate (2.13) which are generically different. We note that the degenerate 



transition matrix from the last part of Chapter 2 also falls into this class. Let us now 
provide the proof of the last theorem of the introduction. 

Proof of Theorem [3} Consider at first the chain which starts in r]{l) = 3, and use 
the corresponding definition of a metastates with this starting measure, calling it K3[77]. 
We then have for the difference of occupation times n7r„(l) — n7r„(2) = / = 0, 1 as the only 
two possible values along a path rj with length n with non-zero probability. More precisely 
we have / = 1 iff 7]{n) = 1 and / = iff 7]{n) G {2, 3}. Call this property {*). 

Let us condition ourselves at first on the event of MC paths where r]{n) = 1 and 7rn(3) 
is NOT 3-like. (By the latter we mean that it does not lie in the stability region for the 
state 3, with an n-dependent safety zone around it, as defined in Section 3.) This means 
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that conditional on this disorder event we do not see the 3-state, we see asymptotically a 
mixture p([3 , B) fi^ [r]] + (1 — p(/3, i3))/i^[r/] between the 1-state and the 2-state with a bias 
p{f3,B) for the 1-state which we expect to be bigger than 1/2. To determine this weight 
note that p{P, B)/{1 — p{P, B)) will be asymptotically given by 



/iF,n[r/(l),...,7/(n- l),?7(n) = l]{a) 



(T:||L„(cr)-7n>*||<£ 



J2 HF,n[v{'^),---,v{n- l),v{n) = l](o-) 

(7:||L„((j)-7n>|||<£ 



(4.3) 



To compute the limit of this expression we use finite-volume manipulations to obtain a 
conditional Gibbs expectation in the following way. We use the property {*) and rewrite 
(4.3), for a possible path r]{l), . . . ,rj{n — l),7/(n) of the chain, 

//F,„[r/(l),...,7/(n- l),??(n) = 2]{a) 

(T:|lL„(o-)-7ri>|||<e 



J2 f^pAvC^), ■ ■ ■ - l),v{n) = l](o-) 

(T:||Ln (o") — 7r/)2 II ^£ 



(4.4) 



We warn the reader that the //-sequence appearing in the Gibbs measure in the numerator 
is not an allowed sequence of the Markov chain any more, but nevertheless the Gibbs 
expression is well defined. 

Splitting off the Hamiltonian appearing in the denominator gives us a difference term 
in the exponent of the numerator at the site n, and we can rewrite the quotient (4.4) as 
a fraction of partition functions with one random field value changed and a conditional 
Gibbs measure in the form 

^F,n[T/(l),..-,??(n- l),r?(n) = 1] 
ZF,n[n{'^),---,v{n- l),^(n) = 2] 

X (/x^,„[r?(l), . . . ,r?(n - l),ry(n) = 2](e^(i---i-=^)| ||L„((7) - 7ru*^\\ < e))"' ^^'^^ 



Note that, by symmetry we have the equality 

^F,n[??(l), ...,v{n- l),T?(re) = 1] 
■Z'F,n[??(l), . . . ,r?(n - l),r/(n) = 2] 



Using 



(4.6) 



(4.7) 



the expected value in (4.5) can be computed, where we note the constraint r/(n) = 2, and 
in this way we get 

/Xi.,„[77(l), . . . , r/(n - l),rj{n) = 2](e^(i-=i-i-=2)| ||L„(a) - 7ri>2* || < e) 
= (e^ - 1)//^,„[7?(1),..., r?(n - 1), r?(n) = 2](l^„=i|||L„(a)-7rz>2*|| <e) (4.8) 
+ (e-^ - l)^^,„[r/(l), ...,r]{n- 1), r?(n) = 2](U„=2| ||^n('7) - 7rz>2*|| < e) + 1 
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Taking into account the conditioning of the total empirical vector and the local knowledge 
of the random field we have e.g. 



/iF,n[r?(l),---,??(n-l),?7(n) = 2](l^„=i| ||L„(ct) - 7rz>^|| < e) ^^^^ 



This gives 



^iF,n[v{^), ■■.,r]{n- 1), r/(n) = 2]{e^^^--=^-^-"=^^\\\Ln{a) - ttu*^ \\ < e) 

^ ie^' - iHvn = 2](l<,„=i|7rP2*) + (e-^ - iHvn = 2](U„=2|vri>2*) + 1 =: Pi\/3,B) 

(4.10) 

With the relation i^^p(^^^B) ~ P^i/^^ ^) metastate for the chain started in state 3 becomes 
K3[r]] = lim P(7r„ is 3-like)(5^3[^] +P(7r„ is not 3-like and G {2, 3})5i^i[.^]^i^2[^] 



+ P(7r„ is not 3-like and r/„ = l)<5p(/3,e)/,i[^]+(i-p(/3,B)), 



21 



U 1 1 



(4.11) 



In the second line we have used that for r/„ G {2,3} the states 1 and 2 are equivalent. 
Further we have used the CLT of the form of Theorem |4] (see the Appendix) and the 
asymptotic decoupling of the state and the occupation time measure. 

The outcome of the previous computation for the metastate depends on the starting point of 
the Markov Chain. We started with r/(l) = 3 and we called k^It]] the associated metastate. 
Similar arguments give for the metastates where the Markov chain starts in the states 1 
and 2 imply tha that ki[7]] = k^It]] whereas 

l^2[r]] = -S^S[ri] + 3'5l^,l[^]+l^2[^] + g5(l-p(/3,B))MM'7]+P{/3,B)M2H (^.12) 

When the disorder starts in equilibrium then 7r(i) = 1/3, i = 1,2, 3, the complete expression 
for the metastate reads: 

^ 2 1 

4v] = ^'^{i)'iM = 3«:i[??] + 3'«2M (4.13) 
j=i 

and from this the statement of Theorem |3] follows. 

Finally let us give some information about the weights p{/3, B). Using the parametriza- 
tion of the minimizers in terms of the order parameter u and the form of the 7-kernels of 
the Potts model we have 

PlHf^,B)= ^+^^^;^ (4.14) 
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Notice that p cannot be equal to 1/2 in the phase trasition region. We claim (4.14) is 
always strictly less than 1 unless n = 0. To see this put x = and y = e^", then we have 
to prove that 

X + y < 1 + xy with x > l,y > 1. (4-15) 

This is clear since, for every x, we have equality in y = 1 and the derivative in y of the 
left term is strictly less than the same derivative on the right. The equality holds only if 
y = 1 or equivalently only if u = 0. □ 

5 Appendix. 

One way to derive a CLT for itn is to use the results in [12] for one-dimensional processes 
defined on a finite state Markov chain together with the Cramer- Wold device. 



Theorem 4 Under our hypothesis on the chain the following CLT holds flS}/ : 

(?7(n), V^{{X, 7r„ - tt)) 4 vr Af{0, (A, SmA)). 

where Sa/ = lim„^+oo ^M,n, with T.M,n{i,j) = nx CovT,{T!:n{i),TTn{j))- 

The theorem can also be rephrased saying that the Markov chain {f]{n))^^-^ and the process 
(n(A, 7r„))„gisj are asymptotically independent. The theorem is a special case of Theorem 
1.1 of 112] when we put Yn := n{X,Ttn) and dM{i, j)(y) := M{i, j)5x(j)idy) in their paper. 
To prove the multidimensional CLT use the previous theorem together with the Cramer- 
Wold device. The latter states that a sequence of random vectors Xi, . . . , Xn converges in 
distribution to X if and only if the scalar product < A, X„ > converges in distribution to 
< A,X > for all A, |A| / 0. 

As an (other) easy way to prove such a result use the regeneration structure [7j of the 
Markov chain, and consider the occupation times between recurrences to a fixed reference 
state. These form an i.i.d. sequence plus a remainder which can be controlled, hence the 
CLT follows. 
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